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Based on the one-parameter generalization of Shannon-Khinchin (SK) axioms presented by one of 
the authors, and utilizing a tree-graphical representation, we have further developed the SK Axioms 
in accordance with the two-parameter entropy introduced by Sharma-Taneja, Mittal, Borges-Roditi, 
and Kaniadakis-Lissia-Scarfone. The corresponding unique theorem is proved. It is shown that the 
obtained two-parameter Shannon additivity is a natural consequence from the Leibniz rule of the 
two-parameter Chakrabarti-Jagannathan difference operator. 



I. INTRODUCTION 

We often encounter complex systems which obey 
asymptotic power-law distribution in many fields such 
as high-energy physics, biophysics, turbulence, scale-free 
networks, economic science and so on. In order to ex- 
plain the statistical natures of such systems, one of the 
fundamental approaches is a generalization of statisti- 
cal mechanics in terms of a suitable generalization of 
the Boltzmann-Gibbs-Shannon(BGS) entropy. Tsallis' 
nonextensive thermostatistics pj 0, y> Qt is one of such 
generalizations. Naudts [f| has developed the generalized 
thermostatistics based on deformed exponential and log- 
arithmic functions in general context. 
In 1975 Sharma and Taneja 0, and independently Mittal 
obtained a two parameter entropy in the field of in- 
formation theory by generalizing Chaundy and McLeod's 
functional equation which characterizes Shannon' en- 
tropy. In the field of statistical physics, quite recently 
Kaniadakis, Lissia and Scarfone [a ll have considered 
a differential-functional equation imposed by the Max- 
Ent principle, and obtained the two-parameter (k and r) 
entropy, 



2k 



(1) 



which is equivalent to the Sharma- Taneja-Mittal entropy. 
For the sake of simplicity Boltzmann' constant fee is set 
to unity in this paper. The two-parameter entropy S K r 
includes some one-parameter generalized entropies which 
proposed by Tsallis J*(j , by Abe ^lj an d by Kaniadakis 
[l2( as a special case. For examples, when r = k and 
q = 1 — 2k, S K , r reduces to Tsallis' entropy 



s q = 
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and when r = 0, S K , r reduces to Kaniadakis' entropy 



S K = 



P i 



l + K 
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(3) 



Consequently the generalization of thermostatistics 
based on the two-parameter entropy provides us a uni- 
fied framework of non-extensive thermostatistics. It has 
been shown that the two-parameter entropy has some im- 
portant thermostatistical properties, such as positivity, 
continuity, expandability, concavity, Lesche stability, and 
so on Thermodynamic stability for microcanoni- 

cal systems described by the two-parameter entropy has 
been studied in Ref. [13. Scarfone has further de- 
veloped the Legendre structure among the generalized 
thermal quantities in the thermostatistics based on the 
two-parameter entropy S K , r . 

Abe 11] provided the procedure which generates an 
entropy functional from the function 



(4) 



where pi is a probability of i-th. event. He observed 
that the BGS entropy is obtained by acting the standard 
derivative on g(s) as 



dg(s) 
ds 



= - ^Pilnpi = S 



BGS 



(5) 



whereas Tsallis' entropy is obtained by acting Jackson's 
g-derivative (or g-difference operator), 



D!/(z) 



nix) - f( x ) 

(q-l)x 



as follows, 



(6) 



(7) 



Johal 0] has established the connection between Tsallis 
entropy for a multifractal distribution and Jackson's q- 
derivative. 
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Based on the same procedure as above, Borges and Roditi 
|16| has obtained the two-parameter generalized entropy, 



determined: 



/8-a 



(8) 



by using the Chakrabarti and Jagannathan (CJ) differ- 
ence operator 



_ /(qg) - f{fix) 
(a — (3)x 



a, (3 G R. 



(9) 



The two-parameter CJ difference operator D" ,/3 includes 
Jackson's ^-derivative as a special case in which a — q, 
and (3=1. The both two-parameter entropies Eqs. l|T]l 
and JHJl are equivalent each other, and they are related 
by 



0-a 



and 1 



a + /3 



(10) 



Note that Eq. © is symmetric under the interchange 
of the two parameters a <-» /3. Consequently the two- 
parameter entropy has the same symmetry. 

On the other hand, it is well known that BGS entropy 
can be characterized by the Shannon-Khinchin (SK) ax- 
ioms 0,0. During the rapid progress of TsaUis' ther- 
mostatistics, the generalized SK axioms were proposed by 
dos Santos [2(J and by Abe |2l|. Later, one of the authors 
|22| has generalized the SK axioms for one-parameter 
generalization of BGS entropy, and proved the unique- 
ness theorem rigorously. To the best of our knowledge, 
there is no generalization of SK axioms for either Kani- 
adakis' entropy S K or the two-parameter entropy S a .p. 
Since S K is a special case of S ai p, it is a natural to gener- 
alize the SK axioms for the two-parameter entropy S a .p. 
This is the main purpose of this paper. In the next sec- 
tion we review the one-parameter (q) generalization of 
SK axioms, among which the key ingredient is the q- 
generalized Shannon additivity. In order to develop a 
two-parameter generalization of the Shannon additivity, 
tree-graphical representation is utilized. In section III 
we prove the uniqueness theorem associated with the ob- 
tained two-parameter SK axioms. Some examples of a 
special case of the two-parameter entropy are presented 
in section IV. In section V it is shown that the two- 
parameter generalized Shannon additivity is symmetric 
under the interchange of the two parameters. The re- 
lation with the Leibniz rule of difference (or derivative) 
operator is discussed. Final section is devoted to our 
conclusion. 



II. ONE-PARAMETER GENERALIZATION OF 
SHANNON ADDITIVITY 

We first briefly review the g-generalized Shannon- 
Khinchin axioms p2^ |. from which the following one- 
parameter (g) generalization of BGS entropy is uniquely 



Sq{pi, . . . ,p n ) 



(ii) 



with q G R + and <j)(q) satisfies the following properties 
i)-iv): 

i) 4>{q) is continuous and has the same sign as q — 1; 

ii) lim^i 4>{q) = 0, and <f>(q) ^ for q ^ 0; 

iii) there exists an interval (a,b) G R + such that 
a < 1 < b and <f>(q) is differentiable on the interval 
( a> l)U(l,6); 



iv) there exists a positive constant k such that 
l 

k ' 



li m , 

mn 9 ^i dq 



The properties i)-iv) guarantee that Eq. reduces to 
BGS entropy in the limit of q — ► 1. In fact, by applying 
the l'Hopital's rule, we confirm that 

lim S q = lim = -kJ2 Pi ln Pi . (12) 

dq i=l 

In physics k is Boltzmann' constant fcs (recall we set it 
unity in this paper), and in information theory A: is a 
suitable constant to set the base of the logarithm, e.g, 
when k = 1/ In 2, the base of the logarithm becomes two. 
Let A„ be defined by the n-dimensional simplex 



(Pi 



Pi > 0,^Pi = 1 



(13) 



i=l 



The g-generalized SK axioms consist of the following four 
conditions: 

• [GSK1] continuity: S q is continuous in A„ and q G 

• [GSK2] maximality: for any n G N and any 

(pi, . . . ,p n ) G A n 



Sq(pi, ■ ■ ■ ,Pn) < S q (-, ■■-,-) 



[GSK3]generalized Shannon additivity: if 



Pij > 0, p l = ^Pij, p(j\i) = —, 

3 = 1 Pl 



(14) 



(15) 



Vi = l, ...,n, Vj = 1, ...,mi 
then the following equality holds 

S q (pn, . . . ,P nmn ) = Sg{pi, . . . , p n ) 
n 

+ ^P?5 8 (p(l|i),...,pK|i)) (16) 
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• [GSK4] expandability: 

S g (pi, . . . ,p n ,0) = S q (pi, ■ ■ ■ ,p n )- (17) 

Note that when q = 1 the above axioms [GSK1]-[GSK4] 
reduce to the original SK axioms 0], respectively. 

Shannon 18j discussed the synthesizing rule of an en- 
tropy with a tree-graphical representation. Let us now 
consider a further generalization of the axiom [GSK3] by 
utilizing the similar tree-graphical representation. Sup- 
pose we have a set of possible events (or choices), and 
let us divide each event (choice) into two successive sub- 
events (choices). Any joint probability of two successive 
sub-events can be expressed as 



Pij =Pi p{j\i), 



(18) 



where Pi(i = 1, . . . , n) is a probability of i-th sub-event 
and p(j\i) a conditional probability, i.e., a probability of 
the j-th sub-event (j = 1, . . . , mj) after the i-th sub-event 
occurred. More specifically, let us consider the following 
simple case in which n — 2 and mi = l,m2 = 2. Each 
probability of any event is graphically represented by a 
thin line as shown in Fig ^ Let S q of Eq. be ex- 





p(2|2) 



FIG. 1: A graphical representation of a set of two successive 
sub-events and associated probabilities Eq. 11811 for n = 2 
and mi = l,m2 = 2. 

pressed as the following trace-form 

71 

S g (pi,...,p n ) =^2s q (pi), (19) 





pK(p(i|i)) 

PS»«(P(1|2)) 
PS«»(P(2|2)) 




»«(Pi)p(1|1) 
»«(P»)P(1|2) 
s 9 (p 2 )p(2|2) 



FIG. 2: A tree graphical representation for the specific exam- 
ple of the q-generalized Shannon additivity Eq. [52] 



weight factor for a first sub-event of successive two sub- 
events is p\ whereas the weight factor for a second sub- 
event is p(j : \i). A natural extension of the one-parameter 
(q) generalized Shannon additivity in the axiom [GSK3] 
to the two-parameter entropy is then to attribute two dif- 
ferent weighs to first and second sub-events, respectively. 
Hereafter we consider a generalized trace-form entropy 



(21) 



depending on the two real-parameter a and f3. Conse- 
quently a two-parameter generalization of Shannon ad- 
ditivity for the above simple example can be expressed 
as 

2 rrii 2 m; 

i=l j—1 4—1 j=l 

2 mi 

+EE s ^)^'W /5 - ( 22 ) 

i=l j=l 



Figgis the graphical representation of Eq. 



where s q (pi) — (j>i — pj) / <fi(q) . Then, for this simple case 
in Fig. ^ Eq. l|16f) in the axiom [GSK3] becomes 

2 mi 2 mi 

EE s< ^') = EE p ? s ApU\ i )) 

i—1 j—1 i—1 j — 1 

2 nii 

+EE s <^)K?H)> (20) 
i=i j=i 

where mi = 1 and w,2 — 2. This can be graphically 
represented as Fig [21 A thick line represents the s q (r) 
of a probability r of the corresponding line, where r is 
Pij, Pi or p(j\i) depending on the line. A thin line repre- 
sents a weight factor, which is either p\ for i-th sub-event 
or p{j\i) for j-th sub-event). Summation over indices is 
represented by a node in each tree graph. Note that the 





Sa,p{p2\) = 

p%S a ,g(p(l\2)) 

P5a a , p {p(2\2)) 




««,/3(pi)p^(l|l) 
s a ,p(p2)p p ! (1|2) 

S Q ,/3(P2)/(2|2) 



FIG. 3: A tree graphical representation of the two-parameter 
generalization of Shannon additivity for the simple case de- 
scribed in Fig. 
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III. TWO-PARAMETER GENERALIZATIONS 
OF SHANNON-KHINCHIN AXIOMS AND THE 
UNIQUENESS THEOREM 



Proof: First we consider the special case as same as Eq. 
(20) of Ref. H3, i.e., Vm, = m and p {j = l/(nm). Then 
Eq. (|2l)|l can be written as 



Now we propose the two-parameter generalization of 
the SK axioms, and prove the unique theorem. 
Theorem: Let A n be an n-dimensional simplex defined 
by Eq. (|13[) . For a generalized trace- form entropy of 
Eq. H21fl , the following two-parameter generalized axioms 
[TGSK1]-[TGSK4] determine the function S a ^ : A„ -> 
R + such that 



S a ,p(p 



p\P\, 



Pn) = E 



Pi -P 







(23) 



where a and are real parameters restricted within the 
regions: 

{(a,0) e R 2 \ a > 1,0 < l} 

Ua,0) £R 2 \a< 1,0 > l} 

but except (a, 0) = (1, 0) and (0, 1). (24) 

and C a ,0 satisfies the following properties I)-IV) 

I) C a ,p is continuous w.r.t. a and 0, and has the 
same sign as — a. Consequently C a ,p is anti- 
symmetric under the interchange of a and 0, i.e., 

II) liniQ,-,^ C Qj( g = 0, and C a ^ ^ for a ^ 0; 

III) there exists an interval (a, b) € R such that C Qj/ 3 is 
diffcrentiable w.r.t. both a and on the interval 
(o,l)U(l,&); 

IV) there exists a positive constant k such that 
linw = -i, and lim^j ^ = ± 

• [TGSK1] continuity: S a ^ is continuous in A„; 

• [TGSK2] maximality: for any n <E N and any 
(pi, . . . ,p n ) S A„ 

S a ,p(Pl, ■■■,Pn)< S a ,p(- t ...,-) (25) 

n n 

• [TGSK3] two-parameter generalized Shannon addi- 
tivity: 

n mi n vai 

EE* " 8 ^ = J2p?J2 s <*,!3(p(j\i)) 
i—1 j — 1 2—1 j — 1 

n mi 

+E s ^)Ek?k) /3 . ( 26 ) 

»=1 3=1 

• [TGSK4] expandability: 

S a ,p(pi, ■ ■ ■ ,p„,0) = S a ^(pi, . . . ,p n ). (27) 



^ n l 1 n l m l 

nms a ,p{ ) = V — ms a ^{ — ) + V s a ,/j(~) V — -s 

2= 1 2—1 j — 1 

=n 1 - Q ms Q , /3 (-) + nTO 1 - /3 s ct , /3 (i) (28) 
m n 

Let A a>l a(n) be defined by 



Aa,/s(n) = Sa,^(")i 



(29) 



then Eq. I|28[l becomes 



Aa,/j(— ) = n 1 "*^-) + m 1 "^,^-). (30) 
nm m n 

Exchanging the variables m and n, we have 

n 1 - Q A Q , (3 (-)+m 1 - /3 A Q ^(-) 
m n 

= m 1 - Q A Q ^(i) + n 1 -^A a ,^(-). (31) 
n m 

The variable m and n are separated as 

m 1 ~ a 

-yr = Ca,/3, (32) 



n l-/3 _„!-(* m l-/3„ m l-a 



Aa,/3(^) 



Aa,/3( 



where C a .p is a constant depending on a and /?. We thus 
find 



A Ql/ g(n) 



Next let us take pij as 



Pij 



n /3-l _ n «-l 
Ca,/3 



(33) 



En i 
r=1 m r 



(34) 



for all i and j, then 



Pij _ 1 



Pi = E^v = ' and PO'IO = — = — • (35) 

~[ l^r=\ m r Pi m i 

Eq. l|2o) becomes 



n mi / 1 \ n mi / 1 

E E s ^ ^ = X>? E (- 

i=l j=l \/^r=l r / j = i j = i \ 1 



n Hi / , \ |3 

E^fe)E - ( 36 ) 

i=l 7=1 ^ *' 
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By utilizing Eqs (|29|l and il-SMI) we have 

n n f 1\ ( I 



i=i 



V*„3 



En 




1-a 



From Eq. it follows 

n / n 

E^' = E< 



(37) 



(38) 



\r=l 



with any real number i, then Eq. (|37|l becomes 



E s «^(k) m i " = E 



C a ,f3 



(39) 



Since we can set rrii arbitrary, by setting rrii = 1 we 
finally obtain 



S a ,fs(pi, ■ ■ ■ ,Pn) = ^2s a ,p(Pt) = E 



Pi -Pi 



(40) 



Now we show that a and (3 are in the regions of Eq. 
(|24[l in order to the S a ^ is definite concave, i.e., the 
second derivative of S a< p w.r.t. the pi should be negative, 



d 2 S a ^ _ a(a - l)pf~ 2 ~ (HP - IK 
dp\ 



< 0. (41) 



From the property I) we see {J3 — a)C a ^p is always posi- 
tive. Then the sign of the numerator multiplied by (3 — a 
should be negative, i.e., 

09 - a) [a(a - l)pf~ 2 - /?(/? - l)p^ 2 } < 0. (42) 

Let us first consider a simple case in which one of the 
terms in the curly bracket of Eq. (|42|l is vanish. When 
(3=1, the condition becomes 



-a(a - l) 2 p°~ 2 < 0. 

Since p t is positive, then a > 0. 
When (3 — 0, the condition becomes 

-a 2 ( a ~l)p^- 2 <0, 



(43) 



(44) 



then a > 1. 

When < (3 < 1, the second term in the curly bracket 
is positive. Then the condition becomes (3 — a < and 
a (a — 1) > 0. This is satisfied with a > 1. The rest 
regions are obtained similar way because the condition 



l - 



FIG. 4: The parameter regions in Eq. 1241 of a and [3 in which 
the two-parameter entropy is definitely concave 



of Eq. 1421 is symmetric under the interchange of a and 
f3. 

The properties II)-IV) are needed in order to the S a ,p 
reduces to the BGS entropy in the limit of a,/3 — ► 1. In 
fact by applying PHopital's rule, we confirm that 



lim S a a = lim ■ 

a,0^1 q-»1 



dC a . B 



da i=l 



IV. SOME EXAMPLES OF A SPECIAL CASE 

For the simplest case in which C a t p = (3 — a, we see 
that 



/3-a 



(x > 0). (46) 



Recalling the relations (|10[1 between the entropic param- 
eters (a, (3) and (ft,r), we see that X a ,p{x) is nothing but 
the two-parameter deformed logarithmic function, 



hi{ K ,r}(£) = 



2 k 



(47) 



which is introduced in Ref. |8(- When a — 1 — k and 
(3 = 1 + k, the deformed logarithmic function reduces to 
k- logarithmic function proposed by Kaniadakis. 



2 k 



ln {K} n. 



(48) 



The entropy S a ^ reduces to Kaniadakis' entropy Eq. |J3}. 
When a — q and (3 = 1, it reduces to Tsallis' g- 
logarithmic function but g replaced with 2 — q 

n 9-i _ x 

K.A n ) g _ 1 = ln 2 - g (n). (49) 
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Accordingly S a> p reduces to Tsallis' entropy Eq. 
More details on the two-parameter deformed logarithms 
and entropies, please refer to Ref. @. 

Another example is Harvda-Charvat |2^| or Daroczi 
|24j entropy, 



S 



HCD 



1 - 2 1 -i 



(50) 



which corresponds to the case C a ,/3 = 1 — 2 1 a , a 
q,/3 = 1 and k = l/ln2. 



V. ON THE TWO-PARAMETER 
GENERALIZED SHANNON ADDITIVITY 

Since Cp tCt — —C a ,p, it is obvious from Eq. <|23(l that 
S a ,0 (and s a jj) is symmetric under the interchange of 
the two-parameter a and (3. Then the two-parameter 
generalized Shannon additivity Eq. I|26|) also must hold 
if a and (3 are interchanged each other, 

n mi n m; 

i—l j — l i—l j — 1 

n rrii 

«=1 3=1 

Then by adding the both sides of Eqs. (12(:i[) and that of 
(|51|l (and dividing by 2) we obtain the symmetric form 

n rrii n rrii 

E E s «./3(py) = E L a,p(pi) E Sa ^ CpOI*)) 

i=l j'=l z=l j=l 

n mi 

<=1 3=1 



where we introduced the function 

t>a,/3(x) 



x a +X 13 



(53) 



Recall Eq. J5J) in which the two-parameter entropy S a ^ 
(and s a ^{pi)) is obtained by acting the CJ difference op- 
erator on g(s) of Eq. fllf. Similarly the function t a ,/3(Pi) 
is obtained from g(s) by acting the average operator 
M"" 8 associated with CJ difference operator 



M' 



(54) 



as follows, 



[^( S )] S=1 =E 



,/3 



E^fe)" ( 55 ) 



From the relations in Eq. (|10|) we see that this is same 
as the function 



l K , r = J^Pl 



-i (Pi+Pi K 



(56) 



which is introduced in Ref. [T^j , and an important quan- 
tity relating the two-parameter generalized entropy of 
Eq. (yi, free-energy, partition function, and other ther- 
modynamical quantities. 

With the help of the average operator M"'^, the Leib- 
niz rule of the CJ difference operator can be written in 
the symmetric form as 

D^(f(x)g(x)) =(p?Pf(zj) (M^g(x)) 

+ (m^/(s))(d^ 5 (*)). (57) 

Then we observe that the two-parameter generalized 
Shannon additivity (|52|l is readily obtained by acting 

d%>p on EjEjKj = EiKEjKiK) 8 ! as can be seen 

from the relation 

E [ D ^U = E [d^iUE K^wru 

i 3 

+j2[ M ^pt] s= iT,[ D ^pum s=1 - 



1,3 



(58) 

Thus we see that the two-parameter Shannon additiv- 
ity is a natural consequence of the Leibniz rule of the 
CJ difference operator. In other words, the Shannon ad- 
ditivity associated with an entropy is the consequence 
of the Leibniz rule of the corresponding difference (or 
derivative) operator which generates the entropy. 

Finally let us comment on the number of the parame- 
ters for generalizing the BGS entropy. One may wonder 
whether a generalization to more than two parameters is 
possible or not. We can answer to this question as fol- 
lows. Recall that a parameter generalization of the BGS 
entropy is obtained by acting a first- order difference op- 
erator on the function g(s), e.g., Eq. Q for the one- 
paramere entropy S q and Eq. (|SJ) for the two-parameter 
entropy S a ,p- Since any first-order difference operator is 
defined by the difference of the functions at two points ( 
e.g., Eq. for D" ,/3 ), such a generalization of the BGS 
entropy is up to two parameters. 



VI. CONCLUSION 

Based on the one-parameter generalized SK axioms 
[22| proposed by one of the authors, we have further de- 
veloped the two-parameter generalization of the SK ax- 
ioms in accordance with the two-parameter entropy in- 
troduced by Sharma-Taneja f6j, MittalJ7j, Borges-Roditi 
and Kaniadakis-Lissia-Scarfone Q, and proved the 
corresponding uniqueness theorem. The Shannon addi- 
tivity, which is a key ingredient of the SK axioms, is 
generalized by considering the tree-graphical representa- 
tion. We have obtained the symmetric form of the two- 
parameter generalized Shannon additivity, and shown the 
relation with the Leibniz rule of the CJ difference oper- 
ator. 
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